Tailoring Interaction. Sensing Social Signals with Textiles.

Nonverbal behaviour is an important part of conversation and can reveal much about the nature of an interaction. It includes phenomena ranging from large-scale posture shifts to small scale nods. Capturing these often spontaneous phenomena requires unobtrusive sensing techniques that do not interfere with the interaction. We propose an underexploited sensing modality for sensing nonverbal behaviours: textiles. As a material in close contact with the body, they provide ubiquitous, large surfaces that make them a suitable soft interface. Although the literature on nonverbal communication focuses on upper body movements such as gestures, observations of multi-party, seated conversations suggest that sitting postures, leg and foot movements are also systematically related to patterns of social interaction. This thesis addressees the following questions: Can the textiles surrounding us measure social engagement? Can they tell who is speaking, and who, if anyone, is listening? Furthermore, how should wearable textile sensing systems be designed and what behavioural signals could textiles reveal? To address these questions, we have designed and manufactured bespoke chairs and trousers with integrated textile pressure sensors, that are introduced here. The designs are evaluated in three user studies that produce multi-modal datasets for the exploration of fine-grained interactional signals. Two approaches to using these bespoke textile sensors are explored. First, hand crafted sensor patches in chair covers serve to distinguish speakers and listeners. Second, a pressure sensitive matrix in custom-made smart trousers is developed to detect static sitting postures, dynamic bodily movement, as well as basic conversational states. Statistical analyses, machine learning approaches, and ethnographic methods show that by moni- toring patterns of pressure change alone it is possible to not only classify postures with high accuracy, but also to identify a wide range of behaviours reliably in individuals and groups. These findings es- tablish textiles as a novel, wearable sensing system for applications in social sciences, and contribute towards a better understanding of nonverbal communication, especially the significance of posture shifts when seated. If chairs know who is speaking, if our trousers can capture our social engagement, what role can smart textiles have in the future of human interaction? How can we build new ways to map social ecologies and tailor interactions

Sensing Social Behavior With Smart Trousers

Nonverbal signals play an important role in social interaction. Body orientation, posture, hand, and leg movements all contribute to successful communication, though research has typically focused on cues transmitted from the torso alone. Here, we explore lower body movements and address two issues. First, the empirical question of what social signals they provide. Second, the technical question of how these movements could be sensed unintrusively and in situations where traditional methods prove challenging. To approach these issues, we propose a soft, wearable sensing system for clothing. Bespoke “smart” trousers with embedded textile pressure sensors are designed and deployed in seated, multiparty conversations. Using simple machine learning techniques and evaluating individual and community models, our results show that it is possible to distinguish basic conversational states. With the trousers picking up speaking, listening, and laughing, they present an appropriate modality to ubiquitously sense human behavior

Singing Knit: Soft Knit Biosensing for Augmenting Vocal Performances

This paper discusses the design of the Singing Knit, a wearable knit collar for measuring a singer's vocal interactions through surface electromyography. We improve the ease and comfort of multi-electrode bio-sensing systems by adapting knit e-textile methods. The goal of the design was to preserve the capabilities of rigid electrode sensing while addressing its shortcomings, focusing on comfort and reliability during extended wear, practicality and convenience for performance settings, and aesthetic value. We use conductive, silver-plated nylon jersey fabric electrodes in a full rib knit accessory for sensing laryngeal muscular activation. We discuss the iterative design and the material decision-making process as a method for building integrated soft-sensing wearable systems for similar settings. Additionally, we discuss how the design choices through the construction process reflect its use in a musical performance context

Initial Investigations into Characterizing DIY E-Textile Stretch Sensors

is paper evaluates three electronic textile (e-textile) stretch sensors commonly constructed for bespoke applications: two variations of fabric knit with a stainless steel and polyester yarn, and knit fabric coated with a conductive polymer. Two versions of the knit stainless steel and polyester yarn sensor, one hand and one machine knit, are evaluated. All of the materials used in the construction of the sensors are accessible to designers and engineers, and are commonly used in wearable technology projects, particularly for arts performance. However, the properties of each sensor have not before been formally analysed. We evaluate the sensors’ performance when being stretched and released

Drawing as transcription: how do graphical techniques inform interaction analysis?

This is an Open Access Article. It is published by Aarhus University Library under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0) licence. Full details of this licence are available at: https://creativecommons.org/licenses/by-nc-nd/4.0/Drawing as a form of analytical inscription can provide researchers with highly flexible methods for exploring embodied interaction. Graphical techniques can combine spatial layouts, trajectories of action and anatomical detail, as well as rich descriptions of movement and temporal effects. This paper introduces some of the possibilities and challenges of adapting graphical techniques from life drawing and still life for interaction research. We demonstrate how many of these techniques are used in interaction research by illustrating the postural configurations and movements of participants in a ballet class. We then discuss a prototype software tool that is being developed to support interaction analysis specifically in the context of a collaborative data analysis session

Embodied Interactions with E-Textiles and the Internet of Sounds for Performing Arts

This paper presents initial steps towards the design of an embedded system for body-centric sonic performance. The proposed prototyping system allows performers to manipulate sounds through gestural interactions captured by textile wearable sensors. The e-textile sensor data control, in real-time, audio synthesis algorithms working with content from Audio Commons, a novel web-based ecosystem for repurposing crowd-sourced audio. The system enables creative embodied music interactions by combining seamless physical e-textiles with web-based digital audio technologies

Posture Shifts in Conversation: An Exploratory Study with Textile Sensors

Posture shifts involving movement of half or more of the body are one of the most conspicuous non-verbal events in conversation. Despite this we know less about what these movements signal about the interaction than we do about smaller scale movements such as nods and gestures. This paper reports an exploratory study of posture shifts in seated conversation. Using data from video analysis and bespoke pressure sensors in clothing, we are able to dis- tinguish different types of posture shifts and detect them in speakers and listeners. The results show that large scale posture shifts are performed by both speaker and listener, ap- pear to be distinct from smaller movements associated with preparing to speak and that the posture shifts associated with speech offset are less clearly defined. We discuss the potential of using pressure sensors to investigate these salient conversational states

Explaining the onset of cohabitation under semi-presidentialism

Semi-presidentialism – where the constitution provides for both a directly elected fixed-term president and a prime minister and cabinet collectively responsible to the legislature – is an increasingly common form of government. For many observers cohabitation is the Achilles heel of semi-presidentialism. This article aims to identify the conditions that are associated with the onset of cohabitation.We specify a number of hypotheses that predict the conditions under which cohabitation should occur.We then test our hypotheses on the basis of a new data set that records every case of cohabitation in all semi-presidential electoral democracies from 1989 to 2008 inclusive.We confirm that cohabi- tation is more likely to occur in countries with a premier-presidential form of semi-presidentialism and show that it is more likely to follow an election that occurs midway through a parliamentary or presidential term, and that when cohabitation follows a presidential election, it is likely to do so in a country where there is only a very weak president. Overall, we find that the conditions under which cohabitation is most likely to occur are also the ones where it is most easily managed. Thus, our findings imply that cohabitation is not likely to be as problematic as the existing literature would suggest